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CLAIMS 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

1 . An encoder apparatus for enabling a push dataflow bitstream without causing a 
modeled data buffer of predetermined memory size for the pushed data at a decoder to 
overflow or underflow/comprising: 

a processor adapted to encode data to provide the bit-stream for communication to 
a decoder; wherein: 

the encoded data comprises at least one video or visual object (VO) with at least 
one video or visual object layer (VOL), including an associated header, followed by at 
least one video or visual object plane (VOP); 

a field in the VOL header designates an occupancy of the buffer just before 
removal of the first VOP following the VOL header from the buffer, and 

said processor uses a simulation to simulate the decoder buffer and controls the 
bitstream in response to the simulation to preclude overflow or underflow of the decoder 
buffer. 

2. The apparatus off claim 1, wherein: 

when the buffer is initially empty, the occupancy field is examined to determine 

an initial occupancy of the buffer before decoding the initial VOP. 

i 

I 

3. The apparatus of claim I, wherein: 

i 

the processor provides a flag to control the inclusion of at least one field in the 

I 
I 
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VOL header when equivalent information is not present in an encapsulating system 
multiplex, 

4. The apparatus of claim 3, wherein: 

the flag allows a visual elementary stream of the bitstream as a standalone entity 
to specify a buffer model. 

5. The apparatus of claim 3, wherein: 

the at least one field whose inclusion in the VOL header is controlled by the flag 
designates a VOP rate of the bitstream. 

6. The apparatus of claim 3 , wherein: 

the at least one field whose inclusion in the VOL header is controlled by the flag 
designates a peak bit rate of the bitstream, 

7. The apparatus of claim 3, wherein: 

the at least one field whose inclusion in the VOL header is controlled by the flag 
designates whether the VOL contains at least one B- VOP. 

8. The apparatus of claim 3, wherein: 

the at least one field whose inclusion in the VOL header is controlled by the flag 
designates the size of the modeled buffer. 
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9. The apparatus of claim 3, wherein: 

the at least one field whose inclusion in the VOL header is controlled by the flag 
designates said field that designates the occupancy of the buffer. 

1 0. The apparatus of claim 1 , wherein: 

the video or visual object comprises a video object. 

1 1 . The apparatus of claim 1 , wherein: 

the video or visual object comprises a still texture object. 

12. The apparatus of claim 1, wherein: 

the video or visual object comprises a mesh object. 

i 

13. The apparatus of claim 1, wherein: 

the video or visual object comprises a face object. 



14. The apparatus of claim 1, wherein: 

the encoded data comprises a plurality of VOLs, and a decoder buffer model is 
applied independently td each VOL using buffer size and rate functions particular to each 
VOL. 

15. The apparatus of jelaim 1, wherein: 

the bitstream is compatible with an MPEG-4 video coding standard. 

| 
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16. The apparatus of claim 1, wherein: 

additional fields are provided in respective subsequent VOL headers to designate 
respective subsequent buffer occupancy levels. 

i 

1 7. The apparatus of claim 1 6, wherein: 

the processor maintains a difference between the additional fields in the 

i 

subsequent VOL headers and a running cumulative buffer occupancy just before removal 
of a VOP from the buffer within a tolerance. 

I 

1 8. The apparatus of claim 1 , wherein: 

the processor determines a size (d,) of a current VOP as a number of bits 
extending to the last bit of the current VOP and starting from either the last bit of the 
previous VO or the first bit of a start code for the first VOP of the encoded data. 

19. The apparatus of claim 1, wherein: 

the processor determines a decoding time t, of an ith VOP, wherein: 

(a) tr=T/ if the VOL contains no B-VOPs, where x, is a composition time of 
the ith VOP, and 

(b) tf=vm, f when the ith VOP is an anchor VOP, and m< accounts for a 

i 
i 

delay of at least one immediately subsequent B-VOP to be composited or 

i 

presented. 

i 

i 

i 

1 5 
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20. The apparatus of claim 1, wherein: 

the processor determines a decoding time t, of an ith VOP, wherein: 

(a) t/=r, if the VOL contains no B-VOPs, where t, is a presentation time of 
the ith VOP when the decoder is a no-compositor decoder, and 

(b) trTrm,-, when the ith VOP is an anchor VOP, and m,- accounts for a 
delay of at least one immediately subsequent B-VOP to be composited or 
presented. 

21. The apparatus of claim I, wherein: 

said pushed data flow comprises video data that includes intraframe (I), prediction 
(P) and bi-directional (B) video object planes (VOPs). 

22. The apparatus of claim 21, wherein said processor controls said bitstream by at 
least one of: allocating bits between different VOPs, and adjusting quantization levels of 
coding units forming said VOPs. 

23. The apparatus of claim 22, wherein: 

the modeled data buffer comprises a visual or video buffering verifier (VBV) 
buffer. j 

i 

24. The apparatus ofj claim 23, wherein: 

said processor monitors the VBV buffer andL, when the simulation indicates that 

i 

i 

i 

6 
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the VBV buffer has or will become too fall, a quantization level for said coding units is 
reduced. 

25. The apparatus of claim 23, wherein: 

said processor monitors the VBV buffer and, when the simulation indicates that 
the VBV buffer has or will become too empty, said quantization level for said coding 
units is increased. 

26. The apparatus of claim 23, wherein: 

said processor monitors the VBV buffer and, when the simulation indicates that 
the VBV buffer has or will become too empty, the generation of the next VOP is delayed. 

27. The apparatus of claim 23, wherein: 

said processor monitors the VBV buffer and, when the simulation indicates that 
the VBV buffer has or will become too empty, high frequency coefficients of said coding 
units are zeroed to neduce the number of bits generated per VOP. 

28. The apparatus of claim 23, wherein: 

said processor monitors the VBV buffer and, when it is determined that the VBV 
buffer has or will become too full, stuffing bits are added to the end of at least one VOP. 

i 
i 

29. The apparatus of claim 1, wherein: 

j 

the processor includes an encoder buffer for receiving the encoded data prior to 
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| 

providing the bitstream therefrom; and 

the processor controls the rate of the bitstream such that the fullness of the 
encoder buffer eb* after encoding an ith VOP is upper bounded by 

i 

L 

I R V<rt«/ic«fcr(t) dt - d» 

i 

where t? is the time of starting to encode the ith VOP, L is the time difference between 
the encoding time V and the decoding time of the ith VOP, d, is the amount of coded data 
for the ith VOP, and R vo uncoder{t) is the instantaneous channel bit rate seen by the 
decoder. 

30. The apparatus of claim 1, wherein: 

the processor includes an encoder buffer for receiving the encoded data prior to 
providing the bitstream therefrom; and 

the processor controls the rate of the bitstream such that the fullness of the 

encoder buffer eb/* after encoding an ith VOP is upper bounded by 

j 

! 

■i j 

I Rvol.t-ncodeAt) dt - do 

tt-L 

! 
j 

8 
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where tf is the time of starting to encode the ith VOP, L is the time difference between 
the encoding time tf and the decoding time of the ith VOP, d, is the amount of coded data 
for the ith VOP, and R w /, fiWOrf *<t) is the instantaneous channel bit rate seen by the 
encoder. 

3 1 . The apparatus of claim 1 , wherein: 

the processor includes an encoder buffer for receiving the encoded data prior to 
providing the bilstream therefrom; and 

the processor controls the rate of the bitstream such that the fullness of the 
encoder buffer ebf after encoding an ith VOP is lower bounded by 

i 

i 

L 

/ R-vol,encoder(fy dt - B, 

tf 

I 

where tf is the time of starting to encode the ith VOP, L is the time difference between 

l 

the encoding time tf and! the decoding time of the ith VOP, B is the size of the decoder 
buffer, and R w ^ OT cfer(t) is the instantaneous channel bit rate seen by the decoder. 

32. The apparatus of claim 1, wherein: 

9 

I 
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the processor includes an encoder buffer for receiving the encoded data prior to 
providing the bitstream therefrom; and the processor controls the rate of the bitstream 
such that the fullness of the encoder buffer eb/ tf after encoding an ith VOP is lower 
bounded by 

/ RvoUncodei{t) dt - B, 

tt'-L 

where tf is the time of starting to encode the ith VOP, L is the time difference between 
the encoding time t/ and the decoding time of the ith VOP, B is the size of the decoder 
buffer, and RvoiencadeJt) is the instantaneous channel bit rate seen by the encoder. 

33. An encoding method for enabling a push dataflow bitstream without causing a 
modeled data buffer of predetermined memory size for the pushed data at a decoder to 
overflow or underflow, comprising the steps of: 

encoding data to provide the bitstream for communication to a decoder; wherein: 
the encodied data comprises at least one video or visual object (VO) with 
at least one video or visual object layer (VOL), including an associated header, 
followed by at least one video or visual object plane (VOP); and 

a field in the VOL header designates an occupancy of the buffer just 
before removal of the first VOP following the VOL header from the buffer; and 
using a simulation to simulate the decoder buffer and control the bitstream in 

i 
i 
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i 

response to the simulation to preclude overflow or underflow of the decoder buffer. 

34. The method of claim 33, wherein: 

when the buffer is initially empty, the occupancy field i$ examined to determine 
an initial occupancy of the buffer before decoding the initial VOP. 

35. The method of claim 33, comprising the further step of: 

providing a flag to control the inclusion of at least one field in the VOL header 
when equivalent information is not present in an encapsulating system multiplex. 

i 
l 

36. The method of claim 35, wherein: 

the flag allows a visual elementary stream of the bitstrcam as a standalone entity 
to specify a buffer model. 

37. The method of claim 35, wherein: 

the at least one field whose inclusion in the VOL header is controlled by the flag 
designates a VOP rate of the bitstream. 

3 8 - The method of claim 3 5 , wherein : 

the at least one field whose inclusion in the VOL header is controlled by the flag 
designates a peak bit rate of the bitstream. 

i 
i 

39. The method of claim 35, wherein: 

I 

| 

i 11 

J 
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the at least one field whose inclusion in the VOL header is controlled by the flag 
designates whether the VOL contains at least one B-VOP. 

40. The method of claim 35, wherein: 

the at least one Held whose inclusion in the VOL header is controlled by the flag 
designates the size of the modeled buffer. 

i 

41. The method of claim 35, wherein: 

the at least one field whose inclusion in the VOL header is controlled by the flag 
designates said field that designates the occupancy of the buffer 

42. The method of claim 33, wherein: 

the video or visual object comprises a video object. 

i 

i 

43 . The method of claim 33 , wherein: 

the video or visual object comprises a still texture object. 

i 

44. The method of claim 33, wherein: 

i 

the video or visual object comprises a mesh object. 

! 
j 

45. The method of claim 33 , wherein: 

the video or visual object comprises a face object. 
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46. The method of claim 33, wherein: 

the encoded data comprises a plurality of VOLs, and a decoder buffer model is 
applied independently to each VOL using buffer size and rate functions particular to each 
VOL. 

47. The method of claim 33, wherein: 

the bitstream is compatible with an MPEG-4 video coding standard. 

48. The method of claim 33, wherein: 

additional fields are provided in respective subsequent VOL headers to designate 
respective subsequent buffer occupancy levels. 

49. The method of claim 48, comprising the further step of: 

maintaining a difference between the additional fields in the subsequent VOL 
headers and a running cumulative buffer occupancy just before removal of a VOP from 
the buffer within a tolerance. 

50. The method of claim 33, comprising the further step of: 

determining a size (dj) of a current VOP as a number of bits extending to the last 

bit of the current VOP arid starting from either the Jast bit of the previous VO or the first 

I 

bit of a start code for the first VOP of the encoded data. 

i 

5 1 . The method of claim 33, comprising the further step of: 

I 13 

l 
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determining a decoding time t, of an ith VOP, wherein: 

i 

(a) ) tr^x, if the VOL contains no B-VOPs, where T/ is a composition time 
of the ith VOP, and 

(b) t/^Trm;, when the ith VOP is an anchor VOP, and m, accounts for a 
delay of at least one immediately subsequent B-VOP to be composited or 
presented. x 

52. The method of claim 33, comprising the further step of: 
determining a decoding time t, of an ith VOP, wherein: 

(a) tr=t, if the VOL contains no B-VOPs, where t, is a presentation time of 
the ith VOP when the decoder is a no-compositor decoder, and 

(b) t,=x r m,, when the ith VOP is an anchor VOP, and m,- accounts for a 
delay of at least one immediately subsequent B-VOP to be composited or 
presented. 

53. The method of claim 33, wherein: 

said pushed data flow comprises video data that includes intTaframe (I), prediction 
(P) and bi-directional (B) video' object planes (VOPs). 

54. The method of claim 53, comprising the further step of controlling said bitstream 
by at least one of: allocating bits between different VOPs, and adjusting quantization 

levels of coding units forming said VOPs. 

I 

i 
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55. The method of claim 54, wherein: 

the modeled data buffer comprises a visual or video buffering verifier (VB V) 

buffer. 

56. The method of claim 55, comprising the further step of; 

monitoring the VBV buffer and, when the simulation indicates that the VBV 
buffer has or will become topfull, reducing a quantization level for $aid coding units. 

57. The method of claim 55, comprising the further step of: 

monitoring the VBV buffer and, when the simulation indicates that the VBV 
buffer has or will become too empty, increasing a quantization level for said coding units. 

58. The method of claim 55, comprising the further step of: 

monitoring the VBV buffer and, when the simulation indicates that the VBV 
buffer has or will become too empty, delaying the generation of the next VOP. 

59. The method of claim 55, comprising the further step of: 

monitoring the VBV buffer and, when the simulation indicates that the VBV 
buffer has or will become too empty, zeroing high frequency coefficients of said coding 
units to reduce the number of bits generated per VOP. 

j 

60. The method of claim 55, comprising the further step of: 

monitoring the VBV buffer and, when it is determined that the VBV buffer has or 

i 
i 
i 
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i 
] 

will become too full, adding stuffing bits to the end of at least one VOP. 

6L The method of claim 33, wherein an encoder buffer receives the encoded data 
prior to providing the bitstream therefrom, comprising the further step of: 

controlling the rate of the bitstream such that the fullness ofthe encoder buffer 
eb * after encoding an ith VOP is upper bounded by 



I Rvot,e*coder(t) dt - d* 



if 



where if is the time of starting to encode the ith VOP, L is the time difference between 
the encoding time tf and the decoding time ofthe ith VOP, d, is the amount of coded data 
for the ith VOP, and R V o/.m C o^r(t) is the instantaneous channel bit rate seen by the 
decoder. 

62. The method of claim 33, wherein an encoder buffer receives the encoded data 
prior to providing the bitstream therefrom, comprising the further step of: 

controlling the rate of the bitstream such that the fullness ofthe encoder buffer 
eh,* after encoding an ith: VOP is upper bounded by 

! 

f *i , RvotencodeAt) dt - di 
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tf-L 



where tf is the time of starting to encode the ith VOP, Lis the time difference between 
the encoding time \? and the decoding time of the ith VOP, d, is the amount of coded data 
for the ith VOP, and R^w^t) is the instantaneous channel bit rate seen by the 
encoder. 

i 

63. The method of claim 33, wherein an encoder buffer receives the encoded data 
prior to providing the bitstream therefrom, comprising the further step of: 

controlling the rate of the bitstream such that the fullness of the encoder buffer 
eb* after encoding an ith VOP is lower bounded by 



Rvo/,<?wexfer(t) dt - B, 



if 



where tf is the time of starting to encode the ith VOP, L is the time difference between 
the encoding time tf and the decoding time of the ith VOP, B is the size of the decoder 
buffer, and Rvo^ncockr(t) is the instantaneous channel bit rate seen by the decoder. 

I 

64. The method of claim 33, wherein an encoder buffer receives the encoded data 

i 
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prior to providing the bitstream therefrom, comprising the further step of: 

controlling the rate of the bitstream such that the fullness of the encoder buffer 
ebf after encoding an ith VOP is lower bounded by 



t? 



I RvoLencodeXt) dt - B, 

tt-L 



where t a e is the time o/starting to encode the ith y p, L is the time difference between the 
encoding time tf and the decoding time of the ith VOP, B is the size of the decoder 

buffer, and R vo i a3COder (t) is the instantaneous channel bit rate seen by the encoder. 

i 

65. A decoder apparatus, comprising: 

a data buffer of predetermined memory size; and 

means for receiving a push dataflow bitstream that is obtained by encoding data in 
accordance with a model of the buffer so that the modeled buffer does not overflow or 
underflow; wherein: 

the encoded data comprises at least one video or visual object (VO) with 

at least one video or visual object layer (VOL), including an associated header, 

i 

followed by at least one video or visual object plane (VOP); and 

i 

a field in the VOL header designates an occupancy of the modeled buffer 
just before removal of the first VOP following the VOL header from the modeled 
buffer. 

i 
» 
i 
i 
i 
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66. The apparatus of claim 65, wherein: 

the encoded data comprises a flag that controls the inclusion of at least one field 
in the VOL header when equivalent information is not present in an encapsulating system 
multiplex, 

67. The apparatus of claim 66, wherein: 

the flag allows a visual elementary stream of the bitstream as a standalone entity 
to specify a buffer modeL 

68. The apparatus of claim 66, wherein: 

the at least one fikld whose inclusion in the VOL header is controlled by the flag 
designates a VOP rate of the bitstream. 

69. The apparatus of claim 66, wherein: 

the at least one field whose inclusion in the VOL header is controlled by the flag 
designates a peak bit rate of the bitstream. 

70. The apparatus of claim 66, wherein: 

the at least one field whose inclusion in the VOL header is controlled by the flag 
designates whether the VOL contains at least one B-VOP. 

i 

71 . The apparatus of claim 66, wherein: 

the at least one field whose inclusion in the VOL header is controlled by the flag 

i 
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designates the size of the modeled buffer 

72. The apparatus of claim 66, wherein: 

the at least one field whose inclusion in the VOL header is controlled by the flag 
designates said field that designates the occupancy of the buffer. 

73. The apparatus of claim 65, wherein: 

the video or visual object comprises a video object. 

74. The apparatus of claim 65, wherein: 

the video or visual object comprises a still texture object 

75. The apparatus of claim 65, wherein: 

the video or visual object comprises a mesh object. 

76. The apparatus of claim 65, wherein: 

the video or visual object comprises a face object. 

77. The apparatus of claim 65, wherein: 

the encoded data comprises a plurality of VOLs, and a decoder buffer model is 

applied independently to each VOL using buffer size and rate functions particular to each 

i 

VOL. | 

i 



i 
i 
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78. The apparatus of claim 65, wherein: 

the bitstream is compatible with an MPEG-4 video coding standard. 

79. The apparatus of claim 65, wherein: 

additional fields are provided in respective subsequent VOL headers to designate 
respective subsequent buffer occupancy levels. 

i 

80. The apparatus of claim 65, wherein: 

said pushed data flow comprises video data that includes intraframe (I), prediction 

(P) and bi-directional (B) video object planes (VOPs). 

i 

81. A method for providing a push dataflow bitstream at a decoder, comprising the 
steps of: 

providing a data buffer of predetermined memory size at the decoder; and 
receiving the push dataflow bitstream at the decoder, wherein said bitstream is 

obtained by encoding data in accordance with a model of the buffer so that the modeled 

buffer does not overflow or underflow; wherein: 

the encoded data comprises at least one video or visual object (VO) with 
at least one video or visual object layer (VOL), including an associated header, 
followed by at least one video or visual object plane (VOP); and 

a field in the VOL header designates an occupancy of the modeled buffer 
just before removal of the first VOP following the VOL header from the modeled 
buffer. 
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